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A COMPARISON OF COMMUNITY COLLEGE RESPONDERS AND 
NON-RESPONDERS TO THE VEDS STUDENT FOLLOW-UP SURVEY 



James Car i f i o , Un i vers i ty of Lowe I I 

Ronald Biron, Massachusetts Board of Regents 

Allen Shwedel, Boston Public Schools 



Abstract 

This study compared a random sample of non-reponders 
<N=380> to the VEDS student follow-up survey to responders 
<K-1881> for 15 community colleges. The study was conducted 
because positive foliow-up results for community colleges 
were cha Hanged by officials due to response rates <35.4%> 
and possible response bias. 

No significant differences were found between responders 
and non-responders on 6 VEDS demographic and 4 VEDS dependent 
variables. Significant difference were found between 
responders and non-responders on special needs and work force 
status, hourly wage of all graduates employed and those 
graduates employed full-time in their area of training. All 
significant differences were in favor of the non-responders. 
Therefore, if b i a^ed , the responder data is b i ased i n the 
d i recti on of under-estimat i on rather than over-est imati on. 
A model was developed to explain these results and results 
are discussed in terms of the model, VEDS, and other surveys. 
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Problem Statement 

The Vocational Education Data System <VEDS> in some form is 
one of the major sources of information for monitoring the impact of 
federal funds allocated for vocational education under PL94-482 and 
for assessing vocational educational trends nationally, locally, and 
at the state level. In most states, two years of student follow-up 
data is currently available from the VEDS system. The results of 
these follow-up studies have ranged from very positive to very 
negative both nationally and at the state level. Clear interpretat- 
ion of these follow-up results have been difficult due to a number of 
factors, among which are response rates and the degree to which the 
results for graduates who return VEDS follow-up surveys are similiar 
to those who do not. 

Not a great deal is known about factors that influence survey 
response rates at the post-secondary level, or about the similarity 
of responders and non-responders in post-secondary surveys. Even 
less is known about the factors that influence responses to the 
nationally mandated VEDS student follow-up survey, or about the 
similarities of VEDS responders and non-responders (Morgan, 1985). 
Given the Major uses of the VEDS student follow-up data, providing 
some preliminary answers to these two outstanding general questions 
would be important to both researchers and dec i son-makers. The 
purpose of the present study, therefore, was to assess the degree to 
which post-secondary VEDS student follow-up responders were similar 
to non-responders in Massachusetts. Answering these two outstanding 
questions became relatively important in Massachusetts as the results 
of two consecutive VEDS surveys at the post-secondary level were so 
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positive as to be queried by both local and state-level decision 
makers due to the respondent rates <35.7X> which were excellent 
comparatively for this type of survey. 

There are 15 public community colleges in Massachusetts which 
offer over 40 different career (occupational educational) programs. 
In September of 1984, a VEDS student follow-up survey was mailed to 
all 1982—1983 public community college career program graduates <N = 
5,267). Of these graduates, 1,881 (35.7%) returned surveys and 3,386 
(64.3X) did not. 

For comparative analyses between the group of graduates who 
return the survey < "responders" > and the gr iup of graduates who did 
not return the survey < M non-responders M > , the non-responder group 
would have to be at least 10% of the size of the responder group. 
To ensure that data on at least 189 non-rosponders <10%> would be 
available, a random sample of 380 non-responder names were generated 
us iris; the random case selection procedures in SPSS. 

Each of the 380 non-responder 1 s last known address was used to 
obtain telephone numbers. Valid telephone numbers were found for 289 
subjects <76.1%>. Over a three day period, up to six attempts were 
made to contact each subject by phone with at least two of the 
attempts made after 6:00 pm. In total, 239 of the non-respondent 
random sample were reached by telephone for the follow-up survey 
interview (see Table 1>. 

Of the 239 non-responders contacted, 4 <1.7%> refused to 
participate, and 34 <14.2%> did not provide sufficient information to 
complete the survey for a variety of reasons. The criteria used to 
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Table 1: NOMINAL AND EFFECTIVE POPULATION, SAMPLE, AND 
RESPONSE RATE PERCENTAGES AND ESTIMATED PERCENTAGES 



f<omi naj Popu I at i on : 5267 graduates 



Responders : 1881 <35.7X> Non-Responders : 3367 <64.3%> 
Usab I e 

Surveys: 1477 <78.5X> 
Not Usable: 404 <21.5%> 

Over-Se I ected 

Random Sample : 380 <11.3X> 



Val id 

Phone Number : 289 <76.1X> 



No Answer 
6 tries: 



50 <13.1X> 



Accessible: 239 <62.9X> 



Usab I e 

Surveys: 201 <84.1%> 

Not Usable: 15 <6.3%> 

No Response: 23 <9.6X> 



Inval i d 
Phone Number : 91 <23.9X> 

Estimate 1 of Inacess i b I e 
graduates (99% conf. level) 

St. Error of Samp I i ng-0.59% 
Min. = 22. OX inacessible 
Max. = 25. 7X inacessible 



imate 2 of Inacessible 
graduates (99% conf. level) 

St. Error of Samp I ing=2.48X 
Min. = 29. 7X i nacess i b I e 
Max. = 38. IX inacessible 



(Effective) Accessible Population Estimates 



mi n i mum 
average 
max imum 



Estimate 1 

N X Nominal 
3919 74. 3X 
4008 76. IX 
4108 78. OX 



Estimate 2 

N X Nominal 
3260 61.9X 
3312 62. 9X 
3703 70. 3X 



Effective Respondent Response Rat e Estimates 



mini mum 
average 
max i mum 



Estimate 1 
<Mi n imum) 

45.8% 

46. 9X 

48.8% 



Estimate 2 
(Max i mum) 

50. 7% 

56. 2X 

57.7% 



ERIC 



Table 2: RANDOMLY SAMPLED NON-RESPONDERS STATUS BY SEX 



c 

r 


ema 1 e 


Ma 1 e 


Toxa 1 


Initial ly Selected 


234 


146 


380 


Invalid Phone Number/Address 


S3 


28 


91 


No answer any of 6 t i mes phoned 


19 


31 


50 


Did Not Call Back for Interview 


10 


9 


19 


Refused to be interviewed 


2 


2 


4 


Provided Incomplete Data 


10 


5 


15 


Comp 1 eted Te 1 e phone Interv i ew 


130 


71 


201 



Table 3: RLASONS GIVEN BY SAMPLED NON-RESPONDERS FOR 
NOT RETURNING MAILED SURVEY 



Reason 


N 


X 


Forgot 


31 


14.4;: 


Did not want -bo complete survey 


12 


6. OX 


Misplaced survey 


26 


12. 9% 


Did not like survey 


1 


0.5X 


Did not like their community college 


2 


1.0% 


Did not understand survey 


0 


O.OX 


Mas not employed 


2 


1.0% 


Never received survey 


103 


51. 2X 


Mailed survey back 


24 


11.9% 


Total 


201 


100.0% 
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Table 4: ORIGINAL RESPONDENTS EFFECTIVE RESPONSE RATE 
ESTIMATES 

Nominal Estimate 1 Estimate 2 

Population (Minimum) (Maximum) 
Survey Responders 35. 7X 46. 9X 56.8% 

Usable Surveys 28.0% 36.9% 44.6% 
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Judge the completeness of the interview-survey were the same as were 
used for the nailed survey; namely, that the respondent provided 
enough information so that her/his sex, ethnic origin, current 
employment status, hourly wage, number of hours worked per week and 
standard occupational classification could be determined. Use of 
these criteria in determining usable surveys in a requirement of the 
VEDS system and VEDS reporting. A total of 201 (84.1%) complete 
phone surveys were obtained within three months of the mailed survey 
(see Table 2). 

The telephone interview used was derived directly from the 
written survey that was mailed to all career program graduates. 
Items on the written survey which were not directly relevant to the 
present study (e.g., "Mere you employed during your enrollment at our 
college?") were not included in the telephone interview. Six items 
not on the written survey were added to the telephone interview to 
find out why subjects had not responded to the written survey. 
Telephone interviews were conducted by 3 different interviewers who 
were trained by an interviewing coordinator. Interviews generally 
took 5 approximately minutes to complete. 



One of the centra I arguments and f i nd i ngs in th i s study is that 
the results of the community college (post—secondary) survey must be 
evaluated in terms of the nominal population surveyed and the 
effective accessible population that is able to respond to the 
survey. This concept is absent in the classical theoretical 
literature on survey research and survey methodology, which assumes 
that the nominal response rate is the effective response rate and 



Results 
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thai low nominal response rates indicate liiased sampling and biased 
results, usually in the positive direction. 

Using this accessibility concept, a high of 38.1% of the nominal 
population wat> estimated to be inacessible from the data in this 
study (see Table 1>. Using this estimate (see Table 4>, the 
effective response rate for the original survey <N=1881> was 56-8% as 
opposed to 35.4% (the nominal response rate). The factors that 
affect accessibility (age, job mobility, schooling, migration, the 
mail and so on), and thus the size of the effective population, 
moreover, appear from the data to be operating randomly, particularly 
as a net effect. Therefore, the responder sample empirically appears 
to be a random sample at the aggregate level. This view is further 
supported by non-respondents' reasons for not responding and the 
comparative results between responders and non-responders (see Table 
5 for a summary of all analyses), and various population values that 
were available (degree level, program, and sex). 

Of the 201 valid non-responders , 103 (51.2%) claimed that they 
had not received the mailed survey (see Table 3) and 24 (11.9%) 
claimed that they had returned the survey by mail. What percentage 
of these 127 subjects were giving socially acceptable answers could 
not be determined, but the combined percentage of these two 
categories (63.1%) closely agrees with the accessibility percentage 
derived and given in Table 1 (62.9%). Thirty-one non-responders 
(14.4%) said they had simply forgotten to complete the survey and 24 
(25%) said that they had misplaced the survey. Only 2 (1%) of the 
non-responders said that they did not want to answer the survey and 
only 2 (1%) said that they did not want to answer the survey because 
they were unemployed. 



Table 5: SUMMARY TABLE OF RESULTS 



Var i ab 1 e 


Test 


Value 


df 


2 


1 . 


Degree Pursued 


Chi Sq. 


7.90 


6 


>.05 


C- m 


Program Pursued 


Chi Sq. 


11.33 


10 


>.05 


o 
O. 


Sax 


Chi Sq. 


1.03 


2 


>.05 


A 

*f • 


Ethn i c Background 


Chi Sq. 


2.44 


4 


>.05 


cr 

b. 


Co 1 1 ege Locat i on 


Chi Sq. 


0.06 


1 


>.05 


o • 


Uuality of Academic 












D r- n ri mm 
■ f uy I a III 


F-test 


0.00 


1,1676 


>.05 


7. 


Qual ity of Job 












Preparat i on 


F-test 


1.75 


1,995 


>.05 


8. 


Employment Statue 


Chi Sq. 


1.91 


1 


>.05 


9. 


Current Educational 


Chi Sq. 


0.90 


1 


>.05 




Status 








10. 


Age in Years 


F-test 


7.71 


1,1665 


<.01* 


11. 


Age by Categories 


Chi Sq. 


8.20 


5 


>.05 


J2. 


Special Needs Status 


Chi Sq. 


44.10 


3 


<.001* 


13. 


Work Force Status 


Chi Sq. 


16.20 


5 


<.001+ 


14. 


Job Relatedness 


Chi Sq. 


21.60 


3 


<.001* 


15. 


Hourly Mage f ul i 












and part-time 


F-test 


5.53 


1,1462 


<.02* 


16. 


Hourly wage full time 












in area of training 


F-test 


7.25 


1,960 


<.007* 


17. 


Hourly wage full time 












not in area of 


F-test 


0.01 


1,213 


>.05 



trai n i ng 
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Table 6: 



DEGREE PERSUED BY STUDY GROUPS 



Samp I ed 

Degree Population Responders Non-Responders 



LeyeJ. 


N 


X 




N 


X 


N 


X 


Assoc i ate 


5062 


96. 


IX 


1429 


96. 7X 


193 


96. OX 


Cert i f i cate 


111 


2. 


1% 


27 


1.8% 


7 


3.5X 


D i p 1 oma 


68 


1. 


3% 


11 


0.7X 


1 


0.5X 


Other 


26 


0. 


5X 


10 


0.8X 


0 


O.OX 



ota I 



5267 100. OX 1477 100. OX 201 100. OX 



Comparisons 
Responder to Non— responder 
Responder to Population 
Non-Responder to Population 
Al I three 



Chi-Sguare df j> 

3.92 3 >.05 

4.16 3 >.05 

3.66 3 >.05 

7.90 6 >.05 



Table 7: two DIGIT OE CODE PROGRAM AREA BY STUDY GROUPS 



Two Digit Population 

Program Area N X 

Services 179 3.4X 

Medical /Health 1377 26. IX 

Chi Id Ca-e/Food 153 2.9X 

Sec/Business 2073 39. 3X 

Technology 1282 24. 3X 

Production/other 169 3.2X 



Samp I ed 
Responders Non-Responders 



N 


X 


N 


X 


41 


2.8X 


8 


4. OX 


374 


25. 3X 


53 


26. 4X 


36 


2.4X 


8 


4. OX 


662 


44. 8X 


72 


35. 8X 


326 


22. IX 


55 


27. 4X 


38 


2.6X 


5 


2.4X 



Total 5267 100. OX 

Comparisons 
Responder to Non-responder 
Responder to Population 
Non-Responder to Population 
Al I three 



1477 100. OX 


201 


100. 


Ch i -Sguare 


df 


e 


8.44 


5 


>.05 


8.10 


5 


>.05 


3.05 


5 


>.05 


11.33 


10 


>.05 
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Table 8: 



SEX BY STUDY GROUPS 



Sex 



Popu I at i on 
N X 



Responders 
N % 



Samp I ed 
Non-Responders 
N X 



Femal e 
Ma I e 



3550 67. 4X 1006 68. IX 130 64 .7% 
1717 32. 6X 471 31. 9X 71 35. 3X 



Total 



5267 100. OX 1477 100. OX 201 100. OX 



Comearisons 
Responder to Non-responder 
Responder to Population 
Non-Responder to Population 
Al I three 



Chj_-Sguare df g 

0.91 1 >.05 

0.23 1 >.05 

0.55 1 >.05 

1.03 2 >.05 



Table 9: ETHNIC BACKGROUND BY STUDY GROUPS 



Samp I ed 

Ethnic Responders Non-Responders 



Background 


N 


X 


N 


X 


White 


1435 


97.2% 


193 


96 


.0% 


Hi span i c 


13 


0.9% 


2 


1. 


.0% 


Black 


18 


1.2% 


5 


2. 


.5% 


As i an 


2 


0.1% 


0 


0. 


.0% 


American Indian 


9 


0.6% 


1 


0. 


.5% 


Total 


1477 


100.0% 


201 


100. 


.0% 



Chi-Square= 2.44 <df=4, p.>.05> 



Table 10: SPECIAL NEEDS STUDENTS BY STUDY GROUPS 



Speci a I 
Needs Status 
Di sadvantaged 
Limited Eng I ish 
Hand i capped 
Other 



Responders 
N % 



15 
10 
11 

3 



1.0% 
0.7% 
0.7% 
0.2% 



Samp I ed 
Non-Responders 
N % 
17 8.5% 
2 1.0% 
0 0.0% 
5 2.5% 



Total 



39 2.6% 



24 11.9% 
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Chi-Square = 44.1 <df=3, p.<.001> 



Table 11: COLLEGE LOCATION BY STUDY GROUP 



Samp I ed 

College Responders Non-Responders 

Location N X N X 

Urban <n=ll> 1224 82.3% 138 83. 6X 

Rural <n=4> 253 17. 7X 33 16. 4X 

Total 1477 _ i6o76% 2d7~~i6676x 

Chi-Square = 0.06 <df=l, p.>.05> 



Table 12: RATING OF THE QUALITY OF ACADEMIC PREPARATION 
BY STUDY GROUP 



Group. N Mean St. Dev A 

Responders 1477 3.96* 0.77 

Sampled Non-Responders 201 3.97 0.80 

TotaS 1678 3.96 0.77 

♦rating could range from 1 (poor) to 5 (excellent) 



SS df MS F Qm.Sg E . 

Between Groups 0.001 1 0.001 0.002 0.0 >.96 

Within Groups 989.7 1676 0.59 



Table 13: RATING OF THE QUALITY OF JOB PREPARATION BY 

STUDY GROUP (COMPLETED ONLY BY THOSE EMPLOYED 
FULL-TIME IN THEIR AREA OF TRAINING). 



Group. 


N 


Mean 


St. Dev. 


Responders 


842 


3.98* 


0.87 


Sampled Non-Responders 


115 


3.87 


0.94 


Total 


957 


3.97 


0.88 


♦rating could range 


from 1 


(poor) to 5 


(exce 1 1 ent) 



SS df MS F Qm.Sg E . 

Between Groups 1.3 1 1.3 1.75 0.0 >.05 

Mi thin Groups 731.2 955 0.8 
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Table 14: EMPLOYMENT STATUS BY STUDY GROUP 



Samp I ed 
Responders Non-Responders 
Status NX N X 

Employed 1282 86.8% 182 90. 5X 

Not Employed 195 12. 2X 19 9.5X 

Total I477~l0076x 26T"T0070X 

Chi-Square = 1.91 <df=l, p.>.05> 



Table 15: WORKFORCE STATUS BY STUDY GROUPS 

Samp I ed 

Current Responders Non— Responders 

Employment Status N X NX 

Employed " 1282 86. 8X 182 90. 5X 

In Hi I itary 5 0.3X 0 0.0X 

Unemployed Seeking 62 4.2X 12 6. OX 

Unemployed not Seeking 25 1.7X 0 0.0X 

Not in Labor Force 103 7. OX 7 3..5X 

Total 1477~10o76x 201~~10070X 

Chi-Square = 16.2 <df=5, p.<.001> 



Table 16: CURRENT EDUCATIONAL STATUS BY STUDY GROUP 

Samp I ed 

Current Responders Non-Responders 

Educational Status NX NX 

Attending Schoo! 446 30. 2X 54 26. 9X 

Not Attending School 1031 69. 8X 147 73. IX 

Total T477~T6o76x 267~~ioo76x 

Chi-Square = 0.94 <df=l, p.>.05> 
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No significant differences between responders and non-responders 
were found in terms of degree level pursued (see Table 6>, program 
(Table 7), sex (Table 8>, ethnic origin (Table 9>» or type of college 
(Table 11) attended (urban or rural). The two groups did differ 
significantly in terms of mean age (F=7. 17, df=l f 1665, p<.01, omega 
squared=0.4X> , with the responder group being older than the non- 
responder group by about 1 year (28.8 versus 27.6 years old). There 
were no significant differences in terms of the frequencies in the 
age categories typically used to analyze this data at the post- 
secondary level (Table 21). There was a statistically significant 
difference (p<.01> in the percentage of special needs students in 
each of the two groups (Table 10). Almost 72% of the non-responder 
group identified themselves as special needs (primarily economically 
disadvantaged) students as compared to only 2.6% of the responder 
group. 

No statistically significant differences were found between 
responders and non-responders in terms of their ratings of the 
academic training they had received at their college (Table 12), or 
in terms of the quality of their occupational preparation (Table 13). 
Responders, however, tended to rate their occupational preparation 
slightly higher than non-responders. 

There were no statistically significant differences in the ratio 
of graduates who were employed versus unemployed in the two groups 
(Table 14). In terms of the non-working categories, responders were 
more likely ( p.< .01 ) to pi ace themse Ives e i ther in the 11 not in the 
labor force" (7%) or "not seeking employment" (2%) category, while 
non-responders were more likely to place themselves in the "seeking 
employment" (4%) category (Table 15). 




Table 17: EMPLOYED GRADUATES ONLY: JOB RELATEDNESS TO AREA 
OF TRAINING BY STUDY GROUPS 



Job 

ReJ_atednegs 
Directly Related 
Somewhat Related 
Remotely Related 
Not Related 



Responders 



Samp lei 
Non-Responders 



N 

776 
247 
73 
186 



X 

60. 5X 
19. 3X 
5.7X 
14. 5X 



N 

107 
26 
2 
47 



X 

58. 9X 
14. 3X 
1.2X 
25.6% 



Total 1282 100. OX 182 100. OX 

Chi -Square = 21.6 <df=3, p.<.001> 



Table 18: HOURLY WAGE IN DOLLARS OF FULL AND PART-TIME 
EMPLOYED GRADUATES BY STUDY GROUPS 



Group N Mean 

Responders 1282 7.40 

Sampled Non-Responders 182 7.90 

Total 1464 7.46 



St. Dev, 
2.66 
2.74 
2.67 



Between Groups 
Within Groups 



SS 
39.37 
10401.16 



df 
1 

1462 



MS 
39.37 
7.11 



F 

5.53 



Om.Sg 
0.36 



< .02* 



Table 19: HOURLY WAGE IN DOLLARS OF GRADUATES WORKING 
FULL-TIME IN A FIELD RELATED TO TRAINING BY STUDY GROUPS 



Group N Mean 

Responders 847 7.67 

Sampled Non-Responders 115 8.32 

Total 962 7.75 



St.. Dev, 
2.39 
2.61 
2.42 



Between Groups 
Within Groups 



SS 
42729 
5597.60 



df 
1 

960 



MS 
42.29 
5.83 



F 

7.25 



0m_- Sg 
0.74 



<. 



007+ 



15 



0 



There were no statistically significant differences between the 
two groups in terms of current school attendance (Table 16). Between 
one quarter and one third of the graduates in each group were 
currently enrolled in school. The two groups did differ (p.<.01> in 
terms of the degree to which their current Job was rated as being 
related to their field of training (Table 17). Subjects in the 
responder group were more likely <p<-01> to have a Job in an area 
which they rated as either directly or somewhat directly related to 
their fielJ of training. 

In terms of average hourly wage, there were statistically 
significant differences (p<.01> between the two groups (Table 18). 
Overall, the responder group averaged $7.40 per hour and the non- 
responder group averaged $7.90 per hour. This effect was linear by 
sex (Table 23) However, a more detailed analysis of average hourly 
wage for graduates working in an area related to their training 
(Table 19) indicated that the non-responders reported earning an even 
higher (p<.007> average hourly wage ($8.32) than resoonders ($7.67). 
This pattern of nigher average hourly wages for non-responders than 
responders was also found in each of seven broadly defined program 
areas (Table 22). 

There were no significant differences in average hourly wages 
between responders and non-responders who were not employed in a 
field related to their training. Responders reported earning $6.84 
per hour, while non-responders reported earning $6.81 per hour. 

*'urther detailed analyses and reports on these data are also I 
available (see Carifio and Shwedel, 1983 and Carifio, Biron, and I 
Shwedel, 1984). | 
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Table 20: HOURLY WAGE IN DOLLARS OF GRADUATES WORKING 
FULL-TIME IN A FIELD NOT RELATED TO TRAINING BY STUDY GROUPS 



Groufi N Mean St. Dev. 

Responders 174 6.84 2.77 

Sampled Non-Responders 41 6.81 2.67 

Total 215 6.04 2.74 



SS df MS F Qm.Sg Ei 

Between Groups 0.03 1 0.03 0.01 0.0 >.05 

Within Groups 1608.53 213 7.55 



Table 21: AGE (CATEGORIES) BY STUDY GROUPS 



Samp I ed 



Age 


Responders 


Non- 


-Respond 




N 


X 


N 


X 


22 and younger 


353 


23. 9X 


42 


20T9X 


23 to 27 


524 


35. 5X 


88 


43. 8X 


28 to 33 


237 


16. OX 


34 


16. 9X 


34 to 39 


185 


12. 5X 


21 


10. 4X 


40 to 45 


86 


5.8X 


10 


5. OX 


46 and above 


80 


5.4% 


5 


2.5X 


Missing data 


12 


0.8X 


1 


0.5X 


Total 


1477 


100. OX 


201 


100. OX 




Chi -Square = 


8.2 <df 


=5, p. 


>.05> 



Table 22: HOURLY WAGE BY DEGREE PROGRAM AREA FOR GRADUATES 
WORKING FULL-TIME IN AREA OF TRAINING BY STUDY GROUPS 



Samp I ed 



Two Digit Degree 


Responders 


Non 


-Responders 


Program Area 


N 


Mean 


SD 


N 


Mean 


SD 


Serv i ces 


25 


6.91 


3.65 


8 


6.99 


2.76 


Medical /Health 


237 


8.20 


1.63 


33 


8.79 


2.25 


Child Care/Food 


16 


4.90 


1.23 


5 


5.12 


1.76 


Sec. /Bus i ness 


385 


7.06 


2.35 


43 


7.79 


2.05 


Techno 1 ogy 


165 


8.83 


2.46 


24 


9.58 


2.93 


Product i on/other 


19 


6.94 


3.03 


2 


10.25 


6.71 


Total 


847 


7.67 


2.39 


115 


8.32 


2.61 
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Table 23: HOURLY WAGE BY SEX BY STUDY GROUP <2X2 ANOVA > 



Females Males 

Study Group. N Mean SD N Mean SD 

Responders 1006 6.21 3.18 471 6.89 4.12 

Non-Responders 131 6.90 3.30 70 7.56 3.88 

Tota I Il37 6729~~3T20"~554 6798 47l0~ 

SS df MS F Qm.Sg. Ei 

Study Group 82.4 1 82.4 6.7 0.8 <.01* 

Sex 169.7 1 169.7 13.8 0.4 <.001* 

Group by Sex 0.01 1 0.01 0.0 0.0 >.05 

Error 20627.2 1674 12.3 
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Discussion 

As the wage data is considered to be the most important and 
critical data in the VEDS follow-up survey, the data from this study 
which included non-responders from 15 colleges and over 40 different 
programs tends to indicate that the data obtained from responders to 
the VEDS survey at the college level tends to be reasonably 
representative of the population of occupational program graduates. 
Furthermore, if biased, the responder data is biased in the direction 
of undei — estimation rather than over—estimation. Decision makers, 
therefore, may be reasonably confident in the representativeness of 
the information the VEDS survey generates at the college level, even 
when the nominal response rates are as low as 25% to 35% of the 
population which they normally tend to be. 

A model was presented to explain and support these findings. 
The nominal versus effective accessible population concept and model 
presented was supported by the results of this study. Based upon the 
results of this study, challenges to the representativeness of the 
VEDS student follow-up survey results at the college level would not 
seem to be empirically supported. Systematic biases in results 
between responders and non-responders were not found for the key 
variables in the VEDS system at the college level across 15 colleges 
and 40 occupational programs. The nominal versus effective 
accessible population model and theoretical concept developed, 
therefore, would seem to be both a sound and usoful concept, 
particularly as the kinds of problems inherent in the VEDS community 
college follow—up survey are present in all kinds of dynamic 
longitudinal surveys and studies. Replication of this study would be 
useful to both strengthen and cross-validate its findings on these 
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important field research questions. 
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